Feature/issue 3311 test thread tbb exp by drezap · Pull Request #3314 · stan-dev/math

drezap · 2026-04-29T21:17:21Z

Summary

I wrote a class that contains an operator for exp, which allows use to use tbb for parallelization of a for loop. It looks like at lower number of observations, the parallelization is marginal, but at higher number of observations the parallelism of the for loop, using tbb::parallel_for, for example, at ~=32,000 there seems to be a speed up at 4 threads that sustains as we increase the size of the Container.

Tests

I tested for numerical accuracy, which checks out. Moreover, I did the following performance tests:

Low number of observations with threading, no threading, and scaling the number of threads (seems to vary based on number of processes running on my computer but marginal speed-up
N=10mm, scaling number of threads. Does not crash, but after a certain amount of threads the speedup plateaus and there is no gain from adding additional threads.
Fix Scale N, fix number of threads. After a certain amount of observations (2^15) definite speed up at even 4 threads. At 2 threads, we don't start to see an advantage until N=2^30, but it kicks in with higher number of threads at lower number of observations.

Side Effects

Yes. If we kick in threads too early, there's actually a slow down in computing exp on a vector with a lower number of observations. May be it would be good if there was a default min threads, or have them kick in only when dataset is a certain size. Moreover, this is just one function, so the result may be different when we have a composite function (Gaussian). I think this may be advantageous at lower number observations, but have not evaluated this.
What I've done is added a directive that runs the multithreaded code for only vector, and calls the original code (but it's copy pasted into the STAN_THREADS section) accordingly if the function is not threaded for exp. I'd be open to a quick re-factor if we wanted to set it up like openCL, and have a threads directory under stan\math\prim.

Release notes

?

Checklist

Copyright holder: (Andre Zapico, Likely LLC, 2026)

The copyright holder is typically you or your assignee, such as a university or company. By submitting this pull request, the copyright holder is agreeing to the license the submitted work under the following licenses:
- Code: BSD 3-clause (https://opensource.org/licenses/BSD-3-Clause)
- Documentation: CC-BY 4.0 (https://creativecommons.org/licenses/by/4.0/)
the basic tests are passing
- unit tests pass (to run, use: ./runTests.py test/unit)
- header checks pass, (make test-headers)
- dependencies checks pass, (make test-math-dependencies)
- docs build, (make doxygen)
- code passes the built in C++ standards checks (make cpplint)
the code is written in idiomatic C++ and changes are documented in the doxygen
the new changes are tested

parallel_for, blocked range compiles for stan::math::exp compiling blocked_range works fine some progress, now a type deduction issue? ok something closer... implement struct version for parallel_for... uncompiled begin new class to use parallel for almost compiles... getting close, have template deduction failed which we can figure out almost compiles hold on compiles remove dead code compiled parallel_for, blocked_range for stan::math::exp compiled parallel_for, blocked_range for stan::math::exp

drezap · 2026-04-29T21:18:41Z

Hold on, sorry I should re-base. I have some questions, wondering if anyone had comments or is this all on me? Refactor, and using threads at lower number of observations.

…rezap/math into feature/issue-3311-test-thread-tbb-exp

SteveBronder · 2026-04-30T21:45:56Z

Do you have a graph that shows the speedup? Overall I'd be kind of cautious introducing lower level threading like this. Like you saw, whether you get a speedup or slowdown depends a lot on the number of observations. So for every vector operations we would have to have a check that the size exceeded some threshold. That threshold is going to vary a lot per computer and I think I think if we are not careful could make the codebase kind of funky.

The other piece here is that this works for prim functions of double type, but parallelism is much harder for reverse mode which is the main piece of the math library we worry about. The main issue is handling how the global AD tape should sync when we have jobs across N threads. @andrjohns thought for a long while trying to figure out how to do a nice parallel map(...) style function for reverse mode autodiff. I'm not sure he came up with something he found satisfying. I have not either honestly. Essentially you need to shard the operation over N shards which will have N autodiff stacks, then once the parallel computation is done you have to pass those autodiff stacks back and put them onto the main thread's stack. So there you would get performance benefits for setting up the forward pass in parallel, but then the reverse pass would still be serial and you pay the cost of the sharding and thread startup. I'm very certain there is a way to do it so you can do the forward and reverse pass in parallel, but nothing has ever come to me for this problem.

drezap · 2026-04-30T22:05:06Z

I’m thinking about, haven’t thought too far ahead yet, thank you. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Thu, Apr 30, 2026 at 5:46 PM Steve Bronder ***@***.***> wrote: *SteveBronder* left a comment (stan-dev/math#3314) <#3314 (comment)> Do you have a graph that shows the speedup? Overall I'd be kind of cautious introducing lower level threading like this. Like you saw, whether you get a speedup or slowdown depends a lot on the number of observations. So for every vector operations we would have to have a check that the size exceeded some threshold. That threshold is going to vary a lot per computer and I think I think if we are not careful could make the codebase kind of funky. The other piece here is that this works for prim functions of double type, but parallelism is much harder for reverse mode which is the main piece of the math library we worry about. The main issue is handling how the global AD tape should sync when we have jobs across N threads. @andrjohns <https://github.com/andrjohns> thought for a long while trying to figure out how to do a nice parallel map(...) style function for reverse mode autodiff. I'm not sure he came up with something he found satisfying. I have not either honestly. Essentially you need to shard the operation over N shards which will have N autodiff stacks, then once the parallel computation is done you have to pass those autodiff stacks back and put them onto the main thread's stack. So there you would get performance benefits for setting up the forward pass in parallel, but then the reverse pass would still be serial and you pay the cost of the sharding and thread startup. I'm very certain there is a way to do it so you can do the forward and reverse pass in parallel, but nothing has ever come to me for this problem. — Reply to this email directly, view it on GitHub <#3314 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACY543AUG7YY66QH7E5MAKL4YPCSVAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DGNJWGM3DSNBVGE> . You are receiving this because you authored the thread.Message ID: ***@***.***>

drezap · 2026-05-01T20:26:11Z

I'm doing continuous integration tests, it looks like it's mostly passing now.
Remaining:

I haven't thought about rev autodiff yet.
I want to see what's going to happen with posteriordb tests
I'll do a run with some Stan models on this branch locally so nothing breaks
Refactor so that the threaded code is in it's own directory like openCL. What I did was add a declarative and copy pasted the prim unthreaded code and then just threaded the part that was vectorized, this is kinda sloppy.
I also just #if0 #endif'd the complex tests and code in the threaded version. I guess I could template it if it's really desired, but to speed it up I just didn't compile complex number support. If it's used a lot, I can fix it.

And I need to consider threading the rev autodiff stack, that would be cool, if different threads could build different expression trees, I think that's what Steve was saying.

But if this adds incremental speed increase, why not?

WRT Steves comment I can think about it, but here I'm not parallelizing anything on the stack, just evaluation of the computation of exp, so that's a bit of a different topic.

stan-buildbot · 2026-05-02T00:26:56Z

Name	Old Result	New Result	Ratio	Performance change( 1 - new / old )
gp_regr/gp_regr.stan	0.1	0.09	1.12	10.42% faster
gp_regr/gen_gp_data.stan	0.03	0.02	1.12	10.64% faster
arK/arK.stan	2.01	1.73	1.16	13.67% faster
eight_schools/eight_schools.stan	0.06	0.05	1.13	11.44% faster
low_dim_gauss_mix_collapse/low_dim_gauss_mix_collapse.stan	9.35	8.41	1.11	10.11% faster
pkpd/one_comp_mm_elim_abs.stan	20.42	18.56	1.1	9.14% faster
pkpd/sim_one_comp_mm_elim_abs.stan	0.27	0.24	1.11	9.86% faster
sir/sir.stan	75.1	72.27	1.04	3.76% faster
gp_pois_regr/gp_pois_regr.stan	3.05	2.94	1.04	3.61% faster
low_dim_gauss_mix/low_dim_gauss_mix.stan	2.83	2.79	1.02	1.56% faster
irt_2pl/irt_2pl.stan	4.54	4.41	1.03	2.86% faster
arma/arma.stan	0.32	0.31	1.01	1.22% faster
garch/garch.stan	0.48	0.46	1.04	3.4% faster
low_dim_corr_gauss/low_dim_corr_gauss.stan	0.01	0.01	1.05	4.86% faster
performance.compilation	221.46	228.05	0.97	-2.98% slower
Mean result: 1.069128278114437

Jenkins Console Log
Blue Ocean
Commit hash: e0729e1cdec40e8ec3da60b40b20a2cfc223fc94

Machine information

No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 20.04.3 LTS Release: 20.04 Codename: focal

CPU:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
Address sizes: 46 bits physical, 48 bits virtual
CPU(s): 80
On-line CPU(s) list: 0-79
Thread(s) per core: 2
Core(s) per socket: 20
Socket(s): 2
NUMA node(s): 2
Vendor ID: GenuineIntel
CPU family: 6
Model: 85
Model name: Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz
Stepping: 4
CPU MHz: 2400.000
CPU max MHz: 3700.0000
CPU min MHz: 1000.0000
BogoMIPS: 4800.00
Virtualization: VT-x
L1d cache: 1.3 MiB
L1i cache: 1.3 MiB
L2 cache: 40 MiB
L3 cache: 55 MiB
NUMA node0 CPU(s): 0,2,4,6,8,10,12,14,16,18,20,22,24,26,28,30,32,34,36,38,40,42,44,46,48,50,52,54,56,58,60,62,64,66,68,70,72,74,76,78
NUMA node1 CPU(s): 1,3,5,7,9,11,13,15,17,19,21,23,25,27,29,31,33,35,37,39,41,43,45,47,49,51,53,55,57,59,61,63,65,67,69,71,73,75,77,79
Vulnerability Gather data sampling: Mitigation; Microcode
Vulnerability Itlb multihit: KVM: Mitigation: Split huge pages
Vulnerability L1tf: Mitigation; PTE Inversion; VMX conditional cache flushes, SMT vulnerable
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT vulnerable
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Mitigation; Clear CPU buffers; SMT vulnerable
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Mitigation; IBRS
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; IBRS; IBPB conditional; STIBP conditional; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT vulnerable
Vulnerability Vmscape: Mitigation; IBPB before exit to userspace
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti intel_ppin ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb intel_pt avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke md_clear flush_l1d arch_capabilities

G++:
g++ (Ubuntu 9.4.0-1ubuntu1~20.04) 9.4.0
Copyright (C) 2019 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Clang:
clang version 10.0.0-4ubuntu1
Target: x86_64-pc-linux-gnu
Thread model: posix
InstalledDir: /usr/bin

drezap · 2026-05-02T02:18:30Z

Not sure why Jenkins emailed me SUCCESS when there's so many errors? I'm not seeing these locally.

I also named the branch wrong, but I'll just leave it until it's closed...

stan-buildbot · 2026-05-02T09:53:31Z

Name	Old Result	New Result	Ratio	Performance change( 1 - new / old )
gp_regr/gp_regr.stan	0.1	0.1	0.99	-1.25% slower
gp_regr/gen_gp_data.stan	0.03	0.02	1.02	1.91% faster
arK/arK.stan	1.89	1.89	1.0	-0.06% slower
eight_schools/eight_schools.stan	0.06	0.06	1.02	1.5% faster
low_dim_gauss_mix_collapse/low_dim_gauss_mix_collapse.stan	9.1	9.2	0.99	-1.08% slower
pkpd/one_comp_mm_elim_abs.stan	20.18	20.28	0.99	-0.51% slower
pkpd/sim_one_comp_mm_elim_abs.stan	0.26	0.26	0.99	-0.98% slower
sir/sir.stan	74.16	74.3	1.0	-0.19% slower
gp_pois_regr/gp_pois_regr.stan	2.89	2.91	1.0	-0.48% slower
low_dim_gauss_mix/low_dim_gauss_mix.stan	2.82	2.79	1.01	1.0% faster
irt_2pl/irt_2pl.stan	4.52	4.47	1.01	1.22% faster
arma/arma.stan	0.31	0.31	1.01	0.53% faster
garch/garch.stan	0.46	0.45	1.01	1.4% faster
low_dim_corr_gauss/low_dim_corr_gauss.stan	0.01	0.01	1.13	11.68% faster
performance.compilation	234.12	225.05	1.04	3.87% faster
Mean result: 1.0136082132108795

Jenkins Console Log
Blue Ocean
Commit hash: e0729e1cdec40e8ec3da60b40b20a2cfc223fc94

Machine information

No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 20.04.3 LTS Release: 20.04 Codename: focal

CPU:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
Address sizes: 46 bits physical, 48 bits virtual
CPU(s): 80
On-line CPU(s) list: 0-79
Thread(s) per core: 2
Core(s) per socket: 20
Socket(s): 2
NUMA node(s): 2
Vendor ID: GenuineIntel
CPU family: 6
Model: 85
Model name: Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz
Stepping: 4
CPU MHz: 2400.000
CPU max MHz: 3700.0000
CPU min MHz: 1000.0000
BogoMIPS: 4800.00
Virtualization: VT-x
L1d cache: 1.3 MiB
L1i cache: 1.3 MiB
L2 cache: 40 MiB
L3 cache: 55 MiB
NUMA node0 CPU(s): 0,2,4,6,8,10,12,14,16,18,20,22,24,26,28,30,32,34,36,38,40,42,44,46,48,50,52,54,56,58,60,62,64,66,68,70,72,74,76,78
NUMA node1 CPU(s): 1,3,5,7,9,11,13,15,17,19,21,23,25,27,29,31,33,35,37,39,41,43,45,47,49,51,53,55,57,59,61,63,65,67,69,71,73,75,77,79
Vulnerability Gather data sampling: Mitigation; Microcode
Vulnerability Itlb multihit: KVM: Mitigation: Split huge pages
Vulnerability L1tf: Mitigation; PTE Inversion; VMX conditional cache flushes, SMT vulnerable
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT vulnerable
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Mitigation; Clear CPU buffers; SMT vulnerable
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Mitigation; IBRS
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; IBRS; IBPB conditional; STIBP conditional; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT vulnerable
Vulnerability Vmscape: Mitigation; IBPB before exit to userspace
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti intel_ppin ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb intel_pt avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke md_clear flush_l1d arch_capabilities

G++:
g++ (Ubuntu 9.4.0-1ubuntu1~20.04) 9.4.0
Copyright (C) 2019 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Clang:
clang version 10.0.0-4ubuntu1
Target: x86_64-pc-linux-gnu
Thread model: posix
InstalledDir: /usr/bin

drezap · 2026-05-28T19:39:07Z

I've already benchmarked it and answered several of your questions. I have an issue open already. Your matrix multiplication benchmarks are in no way comprehensive about answering whether parallelizing functions will scale. And nothing I have built for this project, or any project, has ever needed maintainenance. If you want to take a look at the "levers in play," you can take a look at me benchmarking certain parallelization parameters (i.e. #threads, block size) which will give some insight as to how the different levers perform. You can run multiple threads on one core. I am talking specifically about parallelism. So why are you pointing me to this report? And sure, if your "levers" are something you'd like to evaluate, please itemize them. I've already done some tests to show overhead of initiating threads. What levers would you like to see pulled? Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Thu, May 28, 2026, 2:56 PM Steve Bronder ***@***.***> wrote: Closed #3314 <#3314>. — Reply to this email directly, view it on GitHub <#3314?email_source=notifications&email_token=ACY543FRFK5X4I4JHHGVSPD45CDV7A5CNFSNUABQM5UWIORPF5TWS5BNNB2WEL2JONZXKZKFOZSW45CON52GSZTJMNQXI2LPNYXTENRQG43TQMRRGQ2TJJTSMVQXG33OU5WWK3TUNFXW5JLFOZSW45FMMZXW65DFOJPWG3DJMNVQ#event-26077821454>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACY543BTNXNJESRPD3ED4DL45CDV7AVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV45UABCJFZXG5LFIV3GK3TUJZXXI2LGNFRWC5DJN5XDWMRWGA3TOOBSGE2DKNA> . You are receiving this because you were mentioned.Message ID: ***@***.***>

drezap · 2026-05-28T20:19:12Z

@Steve Bronder ***@***.***> thoughts? I am not sure why you're talking about not parallelization when this is the main topic I'm talking about. Does not make sense. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Thu, May 28, 2026, 3:38 PM Andre Zapico ***@***.***> wrote: I've already benchmarked it and answered several of your questions. I have an issue open already. Your matrix multiplication benchmarks are in no way comprehensive about answering whether parallelizing functions will scale. And nothing I have built for this project, or any project, has ever needed maintainenance. If you want to take a look at the "levers in play," you can take a look at me benchmarking certain parallelization parameters (i.e. #threads, block size) which will give some insight as to how the different levers perform. You can run multiple threads on one core. I am talking specifically about parallelism. So why are you pointing me to this report? And sure, if your "levers" are something you'd like to evaluate, please itemize them. I've already done some tests to show overhead of initiating threads. What levers would you like to see pulled? Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017 On Thu, May 28, 2026, 2:56 PM Steve Bronder ***@***.***> wrote: > Closed #3314 <#3314>. > > — > Reply to this email directly, view it on GitHub > <#3314?email_source=notifications&email_token=ACY543FRFK5X4I4JHHGVSPD45CDV7A5CNFSNUABQM5UWIORPF5TWS5BNNB2WEL2JONZXKZKFOZSW45CON52GSZTJMNQXI2LPNYXTENRQG43TQMRRGQ2TJJTSMVQXG33OU5WWK3TUNFXW5JLFOZSW45FMMZXW65DFOJPWG3DJMNVQ#event-26077821454>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/ACY543BTNXNJESRPD3ED4DL45CDV7AVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV45UABCJFZXG5LFIV3GK3TUJZXXI2LGNFRWC5DJN5XDWMRWGA3TOOBSGE2DKNA> > . > You are receiving this because you were mentioned.Message ID: > ***@***.***> >

SteveBronder · 2026-05-28T20:27:57Z

I've already benchmarked it and answered several of your questions. I have
an issue open already. Your matrix multiplication benchmarks are in no way
comprehensive about answering whether parallelizing functions will scale.

Can you point me to them? I am not seeing google benchmarks in this thread.

And nothing I have built for this project, or any project, has ever needed
maintainenance.

Can you show me a file in Stan math you wrote that does not later have contributors? Looking at the git blame for the gp functions they have been refactored and rewritten over the years. All code adds maintenance.

If you want to take a look at the "levers in play," you can take a look at
me benchmarking certain parallelization parameters (i.e. #threads, block
size) which will give some insight as to how the different levers perform.

I want an actual google benchmark.

You can run multiple threads on one core.
I am talking specifically about parallelism. So why are you pointing me to
this report?

What report are you talking about? stan-perf is a repository with everything setup so that you can use google benchmark for building benchmark experiments. I feel like you are not reading or looking at the resources I am sending you.

And sure, if your "levers" are something you'd like to evaluate, please
itemize them.
I've already done some tests to show overhead of initiating threads.
What levers would you like to see pulled?

A good start would be experiments that check as the size of a vector and number of threads vary how does that affect performance relative to serial execution of the function. You can use the stan-perf repository to setup your benchmarks and execute them. You can fork the stan-perf repository, write your benchmarks, make some nice graphs, and share your code and results.

I've directed you several times to the stan-perf repository to setup your benchmarking code. Is there something I'm missing as to why you do not go and build the benchmarks via that repo and run them? Using google/benchmark will give you consistent and sharable results. You can also output the results to csv/json so you can make nice plots in R or python.

drezap · 2026-05-28T21:12:25Z

Give me a clear ordered list of what you would like to see. There has been minimal changes to the GP functions I've written. Yes, I am aware code requires maintainance. Go ahead and run .run tests.py test/unit/math/prim/fun/exp_test both with and without STAN_THREADS=TRUE, in make local and you will see a huge performance gain, as well as an example of Amdahl's law in practice. Again, not sure why you are referencing benchmarks that have nothing to do with parallelization when this is what we are discussing. Again, I am working on obtaining a functional machine for programming. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Thu, May 28, 2026, 4:28 PM Steve Bronder ***@***.***> wrote: *SteveBronder* left a comment (stan-dev/math#3314) <#3314 (comment)> I've already benchmarked it and answered several of your questions. I have an issue open already. Your matrix multiplication benchmarks are in no way comprehensive about answering whether parallelizing functions will scale. Can you point me to them? I am not seeing google benchmarks in this thread. And nothing I have built for this project, or any project, has ever needed maintainenance. Can you show me a file in Stan math you wrote that does not later have contributors? Looking at the git blame for the gp functions they have been refactored and rewritten over the years. All code adds maintenance. If you want to take a look at the "levers in play," you can take a look at me benchmarking certain parallelization parameters (i.e. #threads, block size) which will give some insight as to how the different levers perform. I want an actual google benchmark. You can run multiple threads on one core. I am talking specifically about parallelism. So why are you pointing me to this report? What report are you talking about? stan-perf is a repository with everything setup so that you can use google benchmark for building benchmark experiments. I feel like you are not reading or looking at the resources I am sending you. And sure, if your "levers" are something you'd like to evaluate, please itemize them. I've already done some tests to show overhead of initiating threads. What levers would you like to see pulled? A good start would be experiments that check as the size of a vector and number of threads vary how does that affect performance relative to serial execution of the function. You can use the stan-perf <https://github.com/SteveBronder/stan-perf> repository to setup your benchmarks and execute them. You can fork the stan-perf repository, write your benchmarks, make some nice graphs, and share your code and results. I've directed you several times to the stan-perf repository to setup your benchmarking code. Is there something I'm missing as to why you do not go and build the benchmarks via that repo and run them? Using google/benchmark will give you consistent and sharable results. You can also output the results to csv/json so you can make nice plots in R or python. — Reply to this email directly, view it on GitHub <#3314?email_source=notifications&email_token=ACY543HXC4X4PW4W54MA2OL45COOHA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJWG44TGMBQGQZKM4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4567930042>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACY543EZC5GG2RFPE5LSPKT45COOHAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKNRXHEZTAMBUGI> . You are receiving this because you were mentioned.Message ID: ***@***.***>

SteveBronder · 2026-05-29T00:51:16Z

I'm very confused. Your benchmarks are very ad hoc and Im asking for more formal benchmarks. I feel I'm not being very heard. You can read the stan-perf repo and post clear benchmarks using the Google benchmark suite provided in that repo.

drezap · 2026-05-29T03:23:44Z

Give me list of parameters you'd like to be benchmarked. Keep in mind, when varied in conjunction this can effect benchmarking results. Can you provide an enum (an ordered enumerated list) of what you'd like to see benchmarked, so we're all not wasting time? Thanks! Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Thu, May 28, 2026, 8:51 PM Steve Bronder ***@***.***> wrote: *SteveBronder* left a comment (stan-dev/math#3314) <#3314 (comment)> I'm very confused. Your benchmarks are very ad hoc and Im asking for more eformal benchmarks. I feel I'm not being very heard. You can read the stan-perf repo and post clear benchmarks using the Google benchmark suite provided in that repo. — Reply to this email directly, view it on GitHub <#3314?email_source=notifications&email_token=ACY543G6HVSYS4WGIMMFATL45DNJXA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJWHE2TANZUGEZ2M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4569507413>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACY543HZZSCM4ZCOMOW76G345DNJXAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKNRZGUYDONBRGM> . You are receiving this because you were mentioned.Message ID: ***@***.***>

SteveBronder · 2026-05-29T06:02:11Z

I would want vectors from size 2 to 32,768 by powers of 2 (so 2, 4, 8, 16,...). Then I would want threads from 1, 2, 4, ... up to the max threads on your computer. If you use stan-perf google benchmark has the tooling setup for this

drezap · 2026-05-29T16:56:12Z

And what parameters, threads, block size, randomly generated number datasets, what PDFs? If you run my tests I've done something similar. Can you be more rigorous about what you would like? Thanks! Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Fri, May 29, 2026, 2:02 AM Steve Bronder ***@***.***> wrote: *SteveBronder* left a comment (stan-dev/math#3314) <#3314 (comment)> I would want vectors from size 2 to 32,768 by powers of 2 (so 2, 4, 8, 16,...). Then I would want threads from 1, 2, 4, ... up to the max threads on your computer. If you use stan-perf google benchmark has the tooling setup for this — Reply to this email directly, view it on GitHub <#3314?email_source=notifications&email_token=ACY543GJV32WT3B6JYTJHPL45ERXTA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJXGEZDSMJRHEY2M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4571291191>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACY543DTKSGDRV3FDN3PX3D45ERXTAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKNZRGI4TCMJZGE> . You are receiving this because you were mentioned.Message ID: ***@***.***>

drezap · 2026-05-29T17:07:15Z

Give me columns and rows of a table you'd like to see and I'll benchmark it. I.e. #threads,block size, Rows: datasetsize, Etc. See what I'm saying? Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Fri, May 29, 2026, 12:55 PM Andre Zapico ***@***.***> wrote: And what parameters, threads, block size, randomly generated number datasets, what PDFs? If you run my tests I've done something similar. Can you be more rigorous about what you would like? Thanks! Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017 On Fri, May 29, 2026, 2:02 AM Steve Bronder ***@***.***> wrote: > *SteveBronder* left a comment (stan-dev/math#3314) > <#3314 (comment)> > > I would want vectors from size 2 to 32,768 by powers of 2 (so 2, 4, 8, > 16,...). Then I would want threads from 1, 2, 4, ... up to the max threads > on your computer. If you use stan-perf google benchmark has the tooling > setup for this > > — > Reply to this email directly, view it on GitHub > <#3314?email_source=notifications&email_token=ACY543GJV32WT3B6JYTJHPL45ERXTA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJXGEZDSMJRHEY2M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4571291191>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/ACY543DTKSGDRV3FDN3PX3D45ERXTAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKNZRGI4TCMJZGE> > . > You are receiving this because you were mentioned.Message ID: > ***@***.***> >

SteveBronder · 2026-05-29T17:53:41Z

I really don't see what you are saying here. Again if you look at the example benchmarks in the stan-perf repo it should be reasonable to fork the repo and copy the current benchmarks into a new folder to run them so that you can run the benchmarks over the serial and parallel exponential function. Your code only changes prim so you only need to use doubles

SteveBronder · 2026-05-29T17:55:05Z

I feel like you are not listening to what I have said here or read the stan-perf repo. At this point it feels like we are talking in circles. If you have specific issues with getting the Stan perf repo running ping me but otherwise I have nothing more to add here

drezap · 2026-05-29T17:58:24Z

What exactly would you like to see evaluated? Be precise. I feel you're being intentionally vague. Which levers do you need pulled? Probably the optimization surface is multimodal but we can use some convex optimization via CVXpy or something to find a local max that could definitely improve performance and could be hidden from users so there's not questions as to how to run something. Give me a table to fill out with benchmarks. Clear, or no? Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Fri, May 29, 2026, 1:54 PM Steve Bronder ***@***.***> wrote: *SteveBronder* left a comment (stan-dev/math#3314) <#3314 (comment)> I really don't see what you are saying here. Again if you look at the example benchmarks in the stan-perf repo it should be reasonable to fork the repo and copy the current benchmarks into a new folder to run them so that you can run the benchmarks over the serial and parallel exponential function. Your code only changes prim so you only need to use doubles — Reply to this email directly, view it on GitHub <#3314?email_source=notifications&email_token=ACY543FPD5YSE6PMUEB3WET45HFDXA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJXHAYTOOBZGA3KM4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4578178906>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACY543EDH7Q5DASOMHLNYGT45HFDXAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKNZYGE3TQOJQGY> . You are receiving this because you were mentioned.Message ID: ***@***.***>

SteveBronder · 2026-05-29T18:26:46Z

You are way overthinking this. I want you to use the Google benchmark library to benchmark only the exponential function for the dimensions and threads I specified above. Nothing else. The stan-perf repo has what you need.

drezap · 2026-05-29T18:33:26Z

I don't think you're being specific enough. You've clearly negated things I have shown and adding additional boundaries to contributing. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Fri, May 29, 2026, 2:27 PM Steve Bronder ***@***.***> wrote: *SteveBronder* left a comment (stan-dev/math#3314) <#3314 (comment)> You are way overthinking this. I want you to use the Google benchmark library to benchmark *only* the exponential function for the dimensions and threads I specified above. Nothing else. The stan-perf repo has what you need. — Reply to this email directly, view it on GitHub <#3314?email_source=notifications&email_token=ACY543DQDPSVP6SKD4IGYID45HI7ZA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJXHA2TKMZSGI3KM4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4578553226>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACY543HDGOBEQK5R3ND6QB345HI7ZAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKNZYGU2TGMRSGY> . You are receiving this because you were mentioned.Message ID: ***@***.***>

drezap · 2026-05-29T18:36:03Z

I am sorry for incorrect grammar, ignoring** things that I have shown. You clearly haven't investigated my benchmarks or given any clear feedback as to what "levers" you'd like to pull. I'm offering my time for free to improve the performance of the math library. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Fri, May 29, 2026, 2:33 PM Andre Zapico ***@***.***> wrote: I don't think you're being specific enough. You've clearly negated things I have shown and adding additional boundaries to contributing. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017 On Fri, May 29, 2026, 2:27 PM Steve Bronder ***@***.***> wrote: > *SteveBronder* left a comment (stan-dev/math#3314) > <#3314 (comment)> > > You are way overthinking this. I want you to use the Google benchmark > library to benchmark *only* the exponential function for the dimensions > and threads I specified above. Nothing else. The stan-perf repo has what > you need. > > — > Reply to this email directly, view it on GitHub > <#3314?email_source=notifications&email_token=ACY543DQDPSVP6SKD4IGYID45HI7ZA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJXHA2TKMZSGI3KM4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4578553226>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/ACY543HDGOBEQK5R3ND6QB345HI7ZAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKNZYGU2TGMRSGY> > . > You are receiving this because you were mentioned.Message ID: > ***@***.***> >

drezap · 2026-05-29T18:41:49Z

And you think principled benchmarks are overthinking? Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Fri, May 29, 2026, 2:35 PM Andre Zapico ***@***.***> wrote: I am sorry for incorrect grammar, ignoring** things that I have shown. You clearly haven't investigated my benchmarks or given any clear feedback as to what "levers" you'd like to pull. I'm offering my time for free to improve the performance of the math library. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017 On Fri, May 29, 2026, 2:33 PM Andre Zapico ***@***.***> wrote: > I don't think you're being specific enough. You've clearly negated things > I have shown and adding additional boundaries to contributing. > > Best, > > > Andre Zapico > linkedin.com/in/andre-zapico > gitub.com/drezap > > > ME Information and Communication Engineering > University of Electronic Science and Technology of China > > Consultant, Owner > likely llc > likelyllc.com > > Stan Developer > mc-stan.org > > BS Mathematical Sciences: Probabilistic Methods > BS Statistics > University of Michigan, Ann Arbor 2017 > > On Fri, May 29, 2026, 2:27 PM Steve Bronder ***@***.***> > wrote: > >> *SteveBronder* left a comment (stan-dev/math#3314) >> <#3314 (comment)> >> >> You are way overthinking this. I want you to use the Google benchmark >> library to benchmark *only* the exponential function for the dimensions >> and threads I specified above. Nothing else. The stan-perf repo has what >> you need. >> >> — >> Reply to this email directly, view it on GitHub >> <#3314?email_source=notifications&email_token=ACY543DQDPSVP6SKD4IGYID45HI7ZA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJXHA2TKMZSGI3KM4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4578553226>, >> or unsubscribe >> <https://github.com/notifications/unsubscribe-auth/ACY543HDGOBEQK5R3ND6QB345HI7ZAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKNZYGU2TGMRSGY> >> . >> You are receiving this because you were mentioned.Message ID: >> ***@***.***> >> >

SteveBronder · 2026-05-29T19:18:47Z

And you think principled benchmarks are overthinking?

Yes absolutely. I want you to use the Google benchmark library to do a microbenchmark of only the exponential function for the dimensions and threads I specified above. Nothing else. The stan-perf repo has what you need.

drezap · 2026-05-29T23:46:40Z

You did not explicitly specify. Please specify in the following response. Give me an "enum," or an ordered list. With this, we can come up with at least a proxy that will give performance gains for users, that can be extracted away from them so they're not confused about the male/local directory. Thank you. I have already exhibited Ahmdal's Law. Moreover, we're not investing whether threads travel through composite functions, etc. I'm up to incorporate stan-perf into Stan/math benchmarks pipeline. I've done some YAML. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Fri, May 29, 2026, 3:19 PM Steve Bronder ***@***.***> wrote: *SteveBronder* left a comment (stan-dev/math#3314) <#3314 (comment)> And you think principled benchmarks are overthinking? Yes absolutely. I want you to use the Google benchmark library to do a microbenchmark of only the exponential function for the dimensions and threads I specified above. Nothing else. The stan-perf repo has what you need. — Reply to this email directly, view it on GitHub <#3314?email_source=notifications&email_token=ACY543BV3B2QLKITRF2F5B345HPC5A5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJXHEYDCNBYGM42M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4579014839>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACY543A3C4JYQLWMYU4AE7345HPC5AVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKNZZGAYTIOBTHE> . You are receiving this because you were mentioned.Message ID: ***@***.***>

drezap · 2026-05-30T05:21:32Z

@wds15, Sebastian, I forget your handle. Thoughts? What columns/covariates would you like to see identified before this moves further? Always up to cancel a useless project, but this could add major gains and it's passing all unit tests. Two commits before was the fastest. I can be more clear/specific with benchmarks. I should be back on a computer Tomorrow. I was looking at #threads, block size, and also fixing and scaling N. also not sure how this will behave with composite functions (every single PDF). ignoring auto diff for now, but just function evaluation threaded could potentially reduce execution time. The tests pass for rev/mix/prim on the fastest implementation, and i'm using declaratives but if there was a serious merge there could be another directory like the openCL GPU stuff. I'm around watching this I'd maintain it. I think it's like 7:30 Berlin time right now. Thoughts on more rigorous evaluation? And then doing something more fancy threading rev would be sweet, but I don't like to spend time on projects that are not thoroughly evaluatee whether they are possible or not. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Fri, May 29, 2026, 7:46 PM Andre Zapico ***@***.***> wrote: You did not explicitly specify. Please specify in the following response. Give me an "enum," or an ordered list. With this, we can come up with at least a proxy that will give performance gains for users, that can be extracted away from them so they're not confused about the male/local directory. Thank you. I have already exhibited Ahmdal's Law. Moreover, we're not investing whether threads travel through composite functions, etc. I'm up to incorporate stan-perf into Stan/math benchmarks pipeline. I've done some YAML. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017 On Fri, May 29, 2026, 3:19 PM Steve Bronder ***@***.***> wrote: > *SteveBronder* left a comment (stan-dev/math#3314) > <#3314 (comment)> > > And you think principled benchmarks are overthinking? > > Yes absolutely. I want you to use the Google benchmark library to do a > microbenchmark of only the exponential function for the dimensions and > threads I specified above. Nothing else. The stan-perf repo has what you > need. > > — > Reply to this email directly, view it on GitHub > <#3314?email_source=notifications&email_token=ACY543BV3B2QLKITRF2F5B345HPC5A5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJXHEYDCNBYGM42M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4579014839>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/ACY543A3C4JYQLWMYU4AE7345HPC5AVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKNZZGAYTIOBTHE> > . > You are receiving this because you were mentioned.Message ID: > ***@***.***> >

drezap · 2026-05-31T04:16:40Z

Alright hold on. new PC. I am just doing basic stuff browsing files. I have 12 cores and I'm using about 2500 threads. Literally nothing but OS updates and browsing. Still can't get into GitHub. But clearly the OS devs are threading under the hood and masking it from users. Let me come up with a concrete list of what's happening and see if you like it. I think Steve had some good insight as to what's good to test? Again this is like one 5 line class. Easy to maintain and I won't disappear. Before just: fix dataset size, vary #threads, block size, (something to else), And then I scaled dataset size, fixing block size and varied threads. So there's this combinatorially increasing # of plots, which is why I didn't feel like plotting it. Once GitHub lets me back in, want me to give you a laundry list? And the I'm open to more people with operating system (OS) dev experience chiming in. But I think capitalizing on this could potentially add gains. And not really much maintenance, I could get prim/rev/mix tests on Travis to pass over night. We just have to worry about stupid stuff like extra copies etc. Deleting unused stuff (on the stack?) after we exit the function. Not sure if C++ has an automatic garbage cleaner like python? You guys would know. In C sometimes people were deleting memory and sometimes not there was not a concrete rule. Thoughts? I think Breve Stonder would have more insight as what to test. Again, happy to run benchmarks and then may be add stan-perf to the pipeline. But also I am thinking whether threads travel through composite functions? Simple stuff like that. Then I could worry about rev mode. Sound silly or no? IDK I am math background. Open to any feedback. And I still can't get into GitHub I am bothering their team. But yeah GitHub what's going on? Cheers everyone. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Sat, May 30, 2026, 1:21 AM Andre Zapico ***@***.***> wrote: @wds15, Sebastian, I forget your handle. Thoughts? What columns/covariates would you like to see identified before this moves further? Always up to cancel a useless project, but this could add major gains and it's passing all unit tests. Two commits before was the fastest. I can be more clear/specific with benchmarks. I should be back on a computer Tomorrow. I was looking at #threads, block size, and also fixing and scaling N. also not sure how this will behave with composite functions (every single PDF). ignoring auto diff for now, but just function evaluation threaded could potentially reduce execution time. The tests pass for rev/mix/prim on the fastest implementation, and i'm using declaratives but if there was a serious merge there could be another directory like the openCL GPU stuff. I'm around watching this I'd maintain it. I think it's like 7:30 Berlin time right now. Thoughts on more rigorous evaluation? And then doing something more fancy threading rev would be sweet, but I don't like to spend time on projects that are not thoroughly evaluatee whether they are possible or not. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017 On Fri, May 29, 2026, 7:46 PM Andre Zapico ***@***.***> wrote: > You did not explicitly specify. Please specify in the following response. > Give me an "enum," or an ordered list. With this, we can come up with at > least a proxy that will give performance gains for users, that can be > extracted away from them so they're not confused about the male/local > directory. > > Thank you. > > I have already exhibited Ahmdal's Law. Moreover, we're not investing > whether threads travel through composite functions, etc. > > I'm up to incorporate stan-perf into Stan/math benchmarks pipeline. I've > done some YAML. > > Best, > > > Andre Zapico > linkedin.com/in/andre-zapico > gitub.com/drezap > > > ME Information and Communication Engineering > University of Electronic Science and Technology of China > > Consultant, Owner > likely llc > likelyllc.com > > Stan Developer > mc-stan.org > > BS Mathematical Sciences: Probabilistic Methods > BS Statistics > University of Michigan, Ann Arbor 2017 > > On Fri, May 29, 2026, 3:19 PM Steve Bronder ***@***.***> > wrote: > >> *SteveBronder* left a comment (stan-dev/math#3314) >> <#3314 (comment)> >> >> And you think principled benchmarks are overthinking? >> >> Yes absolutely. I want you to use the Google benchmark library to do a >> microbenchmark of only the exponential function for the dimensions and >> threads I specified above. Nothing else. The stan-perf repo has what you >> need. >> >> — >> Reply to this email directly, view it on GitHub >> <#3314?email_source=notifications&email_token=ACY543BV3B2QLKITRF2F5B345HPC5A5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJXHEYDCNBYGM42M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4579014839>, >> or unsubscribe >> <https://github.com/notifications/unsubscribe-auth/ACY543A3C4JYQLWMYU4AE7345HPC5AVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKNZZGAYTIOBTHE> >> . >> You are receiving this because you were mentioned.Message ID: >> ***@***.***> >> > > >

drezap · 2026-06-01T06:45:38Z

http://github.com/aditii010 Tagging ***@***.*** Curious to hear your thoughts? I have a math background not an OS background. Steve doesn't seem interested in threading but all OS' do this and abstract from the user. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Sun, May 31, 2026, 12:16 AM Andre Zapico ***@***.***> wrote: Alright hold on. new PC. I am just doing basic stuff browsing files. I have 12 cores and I'm using about 2500 threads. Literally nothing but OS updates and browsing. Still can't get into GitHub. But clearly the OS devs are threading under the hood and masking it from users. Let me come up with a concrete list of what's happening and see if you like it. I think Steve had some good insight as to what's good to test? Again this is like one 5 line class. Easy to maintain and I won't disappear. Before just: fix dataset size, vary #threads, block size, (something to else), And then I scaled dataset size, fixing block size and varied threads. So there's this combinatorially increasing # of plots, which is why I didn't feel like plotting it. Once GitHub lets me back in, want me to give you a laundry list? And the I'm open to more people with operating system (OS) dev experience chiming in. But I think capitalizing on this could potentially add gains. And not really much maintenance, I could get prim/rev/mix tests on Travis to pass over night. We just have to worry about stupid stuff like extra copies etc. Deleting unused stuff (on the stack?) after we exit the function. Not sure if C++ has an automatic garbage cleaner like python? You guys would know. In C sometimes people were deleting memory and sometimes not there was not a concrete rule. Thoughts? I think Breve Stonder would have more insight as what to test. Again, happy to run benchmarks and then may be add stan-perf to the pipeline. But also I am thinking whether threads travel through composite functions? Simple stuff like that. Then I could worry about rev mode. Sound silly or no? IDK I am math background. Open to any feedback. And I still can't get into GitHub I am bothering their team. But yeah GitHub what's going on? Cheers everyone. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017 On Sat, May 30, 2026, 1:21 AM Andre Zapico ***@***.***> wrote: > @wds15, Sebastian, I forget your handle. > > Thoughts? What columns/covariates would you like to see identified before > this moves further? Always up to cancel a useless project, but this could > add major gains and it's passing all unit tests. > > Two commits before was the fastest. I can be more clear/specific with > benchmarks. I should be back on a computer Tomorrow. > > I was looking at #threads, block size, and also fixing and scaling N. > also not sure how this will behave with composite functions (every single > PDF). ignoring auto diff for now, but just function evaluation threaded > could potentially reduce execution time. > > The tests pass for rev/mix/prim on the fastest implementation, and i'm > using declaratives but if there was a serious merge there could be another > directory like the openCL GPU stuff. I'm around watching this I'd maintain > it. I think it's like 7:30 Berlin time right now. > > Thoughts on more rigorous evaluation? > > And then doing something more fancy threading rev would be sweet, but I > don't like to spend time on projects that are not thoroughly evaluatee > whether they are possible or not. > > > > Best, > > > Andre Zapico > linkedin.com/in/andre-zapico > gitub.com/drezap > > > ME Information and Communication Engineering > University of Electronic Science and Technology of China > > Consultant, Owner > likely llc > likelyllc.com > > Stan Developer > mc-stan.org > > BS Mathematical Sciences: Probabilistic Methods > BS Statistics > University of Michigan, Ann Arbor 2017 > > On Fri, May 29, 2026, 7:46 PM Andre Zapico ***@***.***> wrote: > >> You did not explicitly specify. Please specify in the following >> response. Give me an "enum," or an ordered list. With this, we can come up >> with at least a proxy that will give performance gains for users, that can >> be extracted away from them so they're not confused about the male/local >> directory. >> >> Thank you. >> >> I have already exhibited Ahmdal's Law. Moreover, we're not investing >> whether threads travel through composite functions, etc. >> >> I'm up to incorporate stan-perf into Stan/math benchmarks pipeline. I've >> done some YAML. >> >> Best, >> >> >> Andre Zapico >> linkedin.com/in/andre-zapico >> gitub.com/drezap >> >> >> ME Information and Communication Engineering >> University of Electronic Science and Technology of China >> >> Consultant, Owner >> likely llc >> likelyllc.com >> >> Stan Developer >> mc-stan.org >> >> BS Mathematical Sciences: Probabilistic Methods >> BS Statistics >> University of Michigan, Ann Arbor 2017 >> >> On Fri, May 29, 2026, 3:19 PM Steve Bronder ***@***.***> >> wrote: >> >>> *SteveBronder* left a comment (stan-dev/math#3314) >>> <#3314 (comment)> >>> >>> And you think principled benchmarks are overthinking? >>> >>> Yes absolutely. I want you to use the Google benchmark library to do a >>> microbenchmark of only the exponential function for the dimensions and >>> threads I specified above. Nothing else. The stan-perf repo has what you >>> need. >>> >>> — >>> Reply to this email directly, view it on GitHub >>> <#3314?email_source=notifications&email_token=ACY543BV3B2QLKITRF2F5B345HPC5A5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJXHEYDCNBYGM42M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4579014839>, >>> or unsubscribe >>> <https://github.com/notifications/unsubscribe-auth/ACY543A3C4JYQLWMYU4AE7345HPC5AVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKNZZGAYTIOBTHE> >>> . >>> You are receiving this because you were mentioned.Message ID: >>> ***@***.***> >>> >> >> >>

drezap · 2026-06-01T13:04:10Z

Did you get the tag? I can't tell, verification issues. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

---------- Forwarded message --------- From: Aditi Sikarwar ***@***.***> Date: Sun, May 31, 2026, 9:41 AM Subject: Re: Quant Computing OSS To: Andre Zapico ***@***.***> Hey Andre, Yes, definitely interested ! My background is mostly on the GPU/HPC side - CUDA C++, parallel kernel design, memory hierarchy optimisation. I've worked on things like this so the performance engineering side of this is right in my lane even if my Stan internals knowledge is still developing GitHub: github.com/aditii010 Happy to look at the thread once you're tagged in. Aditi

On Sun, 31 May 2026 at 10:10, Andre Zapico ***@***.***> wrote: Hey, Are you interested in quant/stat computing? I have a math background so I am less familiar but still love C++/C and programming. If so, pass me your GitHub handle and I'll tag you in a thread. The Stan math library uses auto diff to compute gradients for arbitrary probabilistic/statistical models but I'm thinking doing some basic concurrency could add huge speed ups (since in iterative algorithms operations are repeated thousands of times, i.e. every PDF uses an exponential). What do you think/what's your GitHub handle? (I am still trying to get access laptop was stolen 🤣). Cheers. Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

SteveBronder · 2026-06-01T17:45:37Z

I blocked on my personal github because I feel like I've tried discussing this with you and it is taking away from time I would like to spend helping other pull requests and issues get resolved.

I've said several times that I'm against this level of automatic parallelization because it will be a lot of maintenance but you keep dismissing my requests without addressing them. I'm going to not reply on this anymore as I just don't know how to continue the discussion in a fruitful way.

drezap · 2026-06-01T23:35:17Z

Whatever feelings don't matter in software dev. ***@***.*** Aditi did you take a look at this? Looking for someone to work with with more expertise in OS dev. Theory is important but concurrency clearly widely used. This project could clearly capitalize on this more. Cheers all, Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Mon, Jun 1, 2026, 1:45 PM Steve Bronder ***@***.***> wrote: *SteveBronder* left a comment (stan-dev/math#3314) <#3314 (comment)> I blocked because I feel like I've tried discussing this with you and it is taking away from time I would like to spend helping other pull requests and issues get resolved. I've said several times that I'm against this level of automatic parallelization because it will be a lot of maintenance but you keep dismissing my requests without addressing them. I'm going to not reply on this anymore as I just don't know how to continue the discussion in a fruitful way. — Reply to this email directly, view it on GitHub <#3314?email_source=notifications&email_token=ACY543COJERYESC7EJXDBMT45W6NPA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJZGUYDOMJXHA42M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4595071789>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACY543FNOWFWAU7P6PJLPAT45W6NPAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKOJVGA3TCNZYHE> . You are receiving this because you were mentioned.Message ID: ***@***.***>

drezap · 2026-06-01T23:37:12Z

I've said several times that I'm against this level of automatic parallelization because it will be a lot of maintenance but you keep dismissing my requests without addressing them. I'm going to not reply on this anymore as I just don't know how to continue the discussion in a fruitful way. — ok Steve give me an ordered list of what you'd like me to address. You still have not clearly addressed these things. Give me like an enum. And yes, I maintaint software and provide reliable analyses. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Mon, Jun 1, 2026, 7:34 PM Andre Zapico ***@***.***> wrote: Whatever feelings don't matter in software dev. ***@***.*** Aditi did you take a look at this? Looking for someone to work with with more expertise in OS dev. Theory is important but concurrency clearly widely used. This project could clearly capitalize on this more. Cheers all, Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017 On Mon, Jun 1, 2026, 1:45 PM Steve Bronder ***@***.***> wrote: > *SteveBronder* left a comment (stan-dev/math#3314) > <#3314 (comment)> > > I blocked because I feel like I've tried discussing this with you and it > is taking away from time I would like to spend helping other pull requests > and issues get resolved. > > I've said several times that I'm against this level of automatic > parallelization because it will be a lot of maintenance but you keep > dismissing my requests without addressing them. I'm going to not reply on > this anymore as I just don't know how to continue the discussion in a > fruitful way. > > — > Reply to this email directly, view it on GitHub > <#3314?email_source=notifications&email_token=ACY543COJERYESC7EJXDBMT45W6NPA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJZGUYDOMJXHA42M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4595071789>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/ACY543FNOWFWAU7P6PJLPAT45W6NPAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKOJVGA3TCNZYHE> > . > You are receiving this because you were mentioned.Message ID: > ***@***.***> >

drezap · 2026-06-01T23:40:48Z

Steve, please list your requests. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Mon, Jun 1, 2026, 7:36 PM Andre Zapico ***@***.***> wrote: I've said several times that I'm against this level of automatic parallelization because it will be a lot of maintenance but you keep dismissing my requests without addressing them. I'm going to not reply on this anymore as I just don't know how to continue the discussion in a fruitful way. — ok Steve give me an ordered list of what you'd like me to address. You still have not clearly addressed these things. Give me like an enum. And yes, I maintaint software and provide reliable analyses. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017 On Mon, Jun 1, 2026, 7:34 PM Andre Zapico ***@***.***> wrote: > Whatever feelings don't matter in software dev. > ***@***.*** > > Aditi did you take a look at this? Looking for someone to work with with > more expertise in OS dev. Theory is important but concurrency clearly > widely used. > > This project could clearly capitalize on this more. > > > Cheers all, > > Best, > > > Andre Zapico > linkedin.com/in/andre-zapico > gitub.com/drezap > > > ME Information and Communication Engineering > University of Electronic Science and Technology of China > > Consultant, Owner > likely llc > likelyllc.com > > Stan Developer > mc-stan.org > > BS Mathematical Sciences: Probabilistic Methods > BS Statistics > University of Michigan, Ann Arbor 2017 > > On Mon, Jun 1, 2026, 1:45 PM Steve Bronder ***@***.***> > wrote: > >> *SteveBronder* left a comment (stan-dev/math#3314) >> <#3314 (comment)> >> >> I blocked because I feel like I've tried discussing this with you and it >> is taking away from time I would like to spend helping other pull requests >> and issues get resolved. >> >> I've said several times that I'm against this level of automatic >> parallelization because it will be a lot of maintenance but you keep >> dismissing my requests without addressing them. I'm going to not reply on >> this anymore as I just don't know how to continue the discussion in a >> fruitful way. >> >> — >> Reply to this email directly, view it on GitHub >> <#3314?email_source=notifications&email_token=ACY543COJERYESC7EJXDBMT45W6NPA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJZGUYDOMJXHA42M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4595071789>, >> or unsubscribe >> <https://github.com/notifications/unsubscribe-auth/ACY543FNOWFWAU7P6PJLPAT45W6NPAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKOJVGA3TCNZYHE> >> . >> You are receiving this because you were mentioned.Message ID: >> ***@***.***> >> > > >

drezap · 2026-06-02T11:16:04Z

Steve, updates? You are paid to work on this project and have not explicitly listed your requirements. Please advise. Kind regards. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Mon, Jun 1, 2026, 7:40 PM Andre Zapico ***@***.***> wrote: Steve, please list your requests. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017 On Mon, Jun 1, 2026, 7:36 PM Andre Zapico ***@***.***> wrote: > I've said several times that I'm against this level of automatic > parallelization because it will be a lot of maintenance but you keep > dismissing my requests without addressing them. I'm going to not reply on > this anymore as I just don't know how to continue the discussion in a > fruitful way. > > — ok Steve give me an ordered list of what you'd like me to address. You > still have not clearly addressed these things. > > Give me like an enum. And yes, I maintaint software and provide reliable > analyses. > > > Best, > > > Andre Zapico > linkedin.com/in/andre-zapico > gitub.com/drezap > > > ME Information and Communication Engineering > University of Electronic Science and Technology of China > > Consultant, Owner > likely llc > likelyllc.com > > Stan Developer > mc-stan.org > > BS Mathematical Sciences: Probabilistic Methods > BS Statistics > University of Michigan, Ann Arbor 2017 > > On Mon, Jun 1, 2026, 7:34 PM Andre Zapico ***@***.***> wrote: > >> Whatever feelings don't matter in software dev. >> ***@***.*** >> >> Aditi did you take a look at this? Looking for someone to work with with >> more expertise in OS dev. Theory is important but concurrency clearly >> widely used. >> >> This project could clearly capitalize on this more. >> >> >> Cheers all, >> >> Best, >> >> >> Andre Zapico >> linkedin.com/in/andre-zapico >> gitub.com/drezap >> >> >> ME Information and Communication Engineering >> University of Electronic Science and Technology of China >> >> Consultant, Owner >> likely llc >> likelyllc.com >> >> Stan Developer >> mc-stan.org >> >> BS Mathematical Sciences: Probabilistic Methods >> BS Statistics >> University of Michigan, Ann Arbor 2017 >> >> On Mon, Jun 1, 2026, 1:45 PM Steve Bronder ***@***.***> >> wrote: >> >>> *SteveBronder* left a comment (stan-dev/math#3314) >>> <#3314 (comment)> >>> >>> I blocked because I feel like I've tried discussing this with you and >>> it is taking away from time I would like to spend helping other pull >>> requests and issues get resolved. >>> >>> I've said several times that I'm against this level of automatic >>> parallelization because it will be a lot of maintenance but you keep >>> dismissing my requests without addressing them. I'm going to not reply on >>> this anymore as I just don't know how to continue the discussion in a >>> fruitful way. >>> >>> — >>> Reply to this email directly, view it on GitHub >>> <#3314?email_source=notifications&email_token=ACY543COJERYESC7EJXDBMT45W6NPA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJZGUYDOMJXHA42M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4595071789>, >>> or unsubscribe >>> <https://github.com/notifications/unsubscribe-auth/ACY543FNOWFWAU7P6PJLPAT45W6NPAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKOJVGA3TCNZYHE> >>> . >>> You are receiving this because you were mentioned.Message ID: >>> ***@***.***> >>> >> >> >> > >

drezap · 2026-06-02T12:50:13Z

It's about working hours ET us. Mind giving me a list of what you need benchmarked? You have refused to do so, and ignorey previous benchmarks. You are getting paid for this. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Tue, Jun 2, 2026, 7:15 AM Andre Zapico ***@***.***> wrote: Steve, updates? You are paid to work on this project and have not explicitly listed your requirements. Please advise. Kind regards. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017 On Mon, Jun 1, 2026, 7:40 PM Andre Zapico ***@***.***> wrote: > Steve, please list your requests. > > Best, > > > Andre Zapico > linkedin.com/in/andre-zapico > gitub.com/drezap > > > ME Information and Communication Engineering > University of Electronic Science and Technology of China > > Consultant, Owner > likely llc > likelyllc.com > > Stan Developer > mc-stan.org > > BS Mathematical Sciences: Probabilistic Methods > BS Statistics > University of Michigan, Ann Arbor 2017 > > On Mon, Jun 1, 2026, 7:36 PM Andre Zapico ***@***.***> wrote: > >> I've said several times that I'm against this level of automatic >> parallelization because it will be a lot of maintenance but you keep >> dismissing my requests without addressing them. I'm going to not reply on >> this anymore as I just don't know how to continue the discussion in a >> fruitful way. >> >> — ok Steve give me an ordered list of what you'd like me to address. You >> still have not clearly addressed these things. >> >> Give me like an enum. And yes, I maintaint software and provide reliable >> analyses. >> >> >> Best, >> >> >> Andre Zapico >> linkedin.com/in/andre-zapico >> gitub.com/drezap >> >> >> ME Information and Communication Engineering >> University of Electronic Science and Technology of China >> >> Consultant, Owner >> likely llc >> likelyllc.com >> >> Stan Developer >> mc-stan.org >> >> BS Mathematical Sciences: Probabilistic Methods >> BS Statistics >> University of Michigan, Ann Arbor 2017 >> >> On Mon, Jun 1, 2026, 7:34 PM Andre Zapico ***@***.***> wrote: >> >>> Whatever feelings don't matter in software dev. >>> ***@***.*** >>> >>> Aditi did you take a look at this? Looking for someone to work with >>> with more expertise in OS dev. Theory is important but concurrency clearly >>> widely used. >>> >>> This project could clearly capitalize on this more. >>> >>> >>> Cheers all, >>> >>> Best, >>> >>> >>> Andre Zapico >>> linkedin.com/in/andre-zapico >>> gitub.com/drezap >>> >>> >>> ME Information and Communication Engineering >>> University of Electronic Science and Technology of China >>> >>> Consultant, Owner >>> likely llc >>> likelyllc.com >>> >>> Stan Developer >>> mc-stan.org >>> >>> BS Mathematical Sciences: Probabilistic Methods >>> BS Statistics >>> University of Michigan, Ann Arbor 2017 >>> >>> On Mon, Jun 1, 2026, 1:45 PM Steve Bronder ***@***.***> >>> wrote: >>> >>>> *SteveBronder* left a comment (stan-dev/math#3314) >>>> <#3314 (comment)> >>>> >>>> I blocked because I feel like I've tried discussing this with you and >>>> it is taking away from time I would like to spend helping other pull >>>> requests and issues get resolved. >>>> >>>> I've said several times that I'm against this level of automatic >>>> parallelization because it will be a lot of maintenance but you keep >>>> dismissing my requests without addressing them. I'm going to not reply on >>>> this anymore as I just don't know how to continue the discussion in a >>>> fruitful way. >>>> >>>> — >>>> Reply to this email directly, view it on GitHub >>>> <#3314?email_source=notifications&email_token=ACY543COJERYESC7EJXDBMT45W6NPA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJZGUYDOMJXHA42M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4595071789>, >>>> or unsubscribe >>>> <https://github.com/notifications/unsubscribe-auth/ACY543FNOWFWAU7P6PJLPAT45W6NPAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKOJVGA3TCNZYHE> >>>> . >>>> You are receiving this because you were mentioned.Message ID: >>>> ***@***.***> >>>> >>> >>> >>> >> >>

drezap · 2026-06-02T18:40:51Z

Any updates? These are working hours. Thanks all. Steve has not provided objective for what he needs. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Tue, Jun 2, 2026, 8:49 AM Andre Zapico ***@***.***> wrote: It's about working hours ET us. Mind giving me a list of what you need benchmarked? You have refused to do so, and ignorey previous benchmarks. You are getting paid for this. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017 On Tue, Jun 2, 2026, 7:15 AM Andre Zapico ***@***.***> wrote: > Steve, updates? You are paid to work on this project and have not > explicitly listed your requirements. > > Please advise. > > Kind regards. > > Best, > > > Andre Zapico > linkedin.com/in/andre-zapico > gitub.com/drezap > > > ME Information and Communication Engineering > University of Electronic Science and Technology of China > > Consultant, Owner > likely llc > likelyllc.com > > Stan Developer > mc-stan.org > > BS Mathematical Sciences: Probabilistic Methods > BS Statistics > University of Michigan, Ann Arbor 2017 > > On Mon, Jun 1, 2026, 7:40 PM Andre Zapico ***@***.***> wrote: > >> Steve, please list your requests. >> >> Best, >> >> >> Andre Zapico >> linkedin.com/in/andre-zapico >> gitub.com/drezap >> >> >> ME Information and Communication Engineering >> University of Electronic Science and Technology of China >> >> Consultant, Owner >> likely llc >> likelyllc.com >> >> Stan Developer >> mc-stan.org >> >> BS Mathematical Sciences: Probabilistic Methods >> BS Statistics >> University of Michigan, Ann Arbor 2017 >> >> On Mon, Jun 1, 2026, 7:36 PM Andre Zapico ***@***.***> wrote: >> >>> I've said several times that I'm against this level of automatic >>> parallelization because it will be a lot of maintenance but you keep >>> dismissing my requests without addressing them. I'm going to not reply on >>> this anymore as I just don't know how to continue the discussion in a >>> fruitful way. >>> >>> — ok Steve give me an ordered list of what you'd like me to address. >>> You still have not clearly addressed these things. >>> >>> Give me like an enum. And yes, I maintaint software and provide >>> reliable analyses. >>> >>> >>> Best, >>> >>> >>> Andre Zapico >>> linkedin.com/in/andre-zapico >>> gitub.com/drezap >>> >>> >>> ME Information and Communication Engineering >>> University of Electronic Science and Technology of China >>> >>> Consultant, Owner >>> likely llc >>> likelyllc.com >>> >>> Stan Developer >>> mc-stan.org >>> >>> BS Mathematical Sciences: Probabilistic Methods >>> BS Statistics >>> University of Michigan, Ann Arbor 2017 >>> >>> On Mon, Jun 1, 2026, 7:34 PM Andre Zapico ***@***.***> >>> wrote: >>> >>>> Whatever feelings don't matter in software dev. >>>> ***@***.*** >>>> >>>> Aditi did you take a look at this? Looking for someone to work with >>>> with more expertise in OS dev. Theory is important but concurrency clearly >>>> widely used. >>>> >>>> This project could clearly capitalize on this more. >>>> >>>> >>>> Cheers all, >>>> >>>> Best, >>>> >>>> >>>> Andre Zapico >>>> linkedin.com/in/andre-zapico >>>> gitub.com/drezap >>>> >>>> >>>> ME Information and Communication Engineering >>>> University of Electronic Science and Technology of China >>>> >>>> Consultant, Owner >>>> likely llc >>>> likelyllc.com >>>> >>>> Stan Developer >>>> mc-stan.org >>>> >>>> BS Mathematical Sciences: Probabilistic Methods >>>> BS Statistics >>>> University of Michigan, Ann Arbor 2017 >>>> >>>> On Mon, Jun 1, 2026, 1:45 PM Steve Bronder ***@***.***> >>>> wrote: >>>> >>>>> *SteveBronder* left a comment (stan-dev/math#3314) >>>>> <#3314 (comment)> >>>>> >>>>> I blocked because I feel like I've tried discussing this with you and >>>>> it is taking away from time I would like to spend helping other pull >>>>> requests and issues get resolved. >>>>> >>>>> I've said several times that I'm against this level of automatic >>>>> parallelization because it will be a lot of maintenance but you keep >>>>> dismissing my requests without addressing them. I'm going to not reply on >>>>> this anymore as I just don't know how to continue the discussion in a >>>>> fruitful way. >>>>> >>>>> — >>>>> Reply to this email directly, view it on GitHub >>>>> <#3314?email_source=notifications&email_token=ACY543COJERYESC7EJXDBMT45W6NPA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJZGUYDOMJXHA42M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4595071789>, >>>>> or unsubscribe >>>>> <https://github.com/notifications/unsubscribe-auth/ACY543FNOWFWAU7P6PJLPAT45W6NPAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKOJVGA3TCNZYHE> >>>>> . >>>>> You are receiving this because you were mentioned.Message ID: >>>>> ***@***.***> >>>>> >>>> >>>> >>>> >>> >>>

drezap · 2026-06-03T13:47:47Z

Still waiting @Steve Bronder ***@***.***> Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017

…

On Tue, Jun 2, 2026, 2:40 PM Andre Zapico ***@***.***> wrote: Any updates? These are working hours. Thanks all. Steve has not provided objective for what he needs. Best, Andre Zapico linkedin.com/in/andre-zapico gitub.com/drezap ME Information and Communication Engineering University of Electronic Science and Technology of China Consultant, Owner likely llc likelyllc.com Stan Developer mc-stan.org BS Mathematical Sciences: Probabilistic Methods BS Statistics University of Michigan, Ann Arbor 2017 On Tue, Jun 2, 2026, 8:49 AM Andre Zapico ***@***.***> wrote: > It's about working hours ET us. Mind giving me a list of what you need > benchmarked? > > You have refused to do so, and ignorey previous benchmarks. > > You are getting paid for this. > > Best, > > > Andre Zapico > linkedin.com/in/andre-zapico > gitub.com/drezap > > > ME Information and Communication Engineering > University of Electronic Science and Technology of China > > Consultant, Owner > likely llc > likelyllc.com > > Stan Developer > mc-stan.org > > BS Mathematical Sciences: Probabilistic Methods > BS Statistics > University of Michigan, Ann Arbor 2017 > > On Tue, Jun 2, 2026, 7:15 AM Andre Zapico ***@***.***> wrote: > >> Steve, updates? You are paid to work on this project and have not >> explicitly listed your requirements. >> >> Please advise. >> >> Kind regards. >> >> Best, >> >> >> Andre Zapico >> linkedin.com/in/andre-zapico >> gitub.com/drezap >> >> >> ME Information and Communication Engineering >> University of Electronic Science and Technology of China >> >> Consultant, Owner >> likely llc >> likelyllc.com >> >> Stan Developer >> mc-stan.org >> >> BS Mathematical Sciences: Probabilistic Methods >> BS Statistics >> University of Michigan, Ann Arbor 2017 >> >> On Mon, Jun 1, 2026, 7:40 PM Andre Zapico ***@***.***> wrote: >> >>> Steve, please list your requests. >>> >>> Best, >>> >>> >>> Andre Zapico >>> linkedin.com/in/andre-zapico >>> gitub.com/drezap >>> >>> >>> ME Information and Communication Engineering >>> University of Electronic Science and Technology of China >>> >>> Consultant, Owner >>> likely llc >>> likelyllc.com >>> >>> Stan Developer >>> mc-stan.org >>> >>> BS Mathematical Sciences: Probabilistic Methods >>> BS Statistics >>> University of Michigan, Ann Arbor 2017 >>> >>> On Mon, Jun 1, 2026, 7:36 PM Andre Zapico ***@***.***> >>> wrote: >>> >>>> I've said several times that I'm against this level of automatic >>>> parallelization because it will be a lot of maintenance but you keep >>>> dismissing my requests without addressing them. I'm going to not reply on >>>> this anymore as I just don't know how to continue the discussion in a >>>> fruitful way. >>>> >>>> — ok Steve give me an ordered list of what you'd like me to address. >>>> You still have not clearly addressed these things. >>>> >>>> Give me like an enum. And yes, I maintaint software and provide >>>> reliable analyses. >>>> >>>> >>>> Best, >>>> >>>> >>>> Andre Zapico >>>> linkedin.com/in/andre-zapico >>>> gitub.com/drezap >>>> >>>> >>>> ME Information and Communication Engineering >>>> University of Electronic Science and Technology of China >>>> >>>> Consultant, Owner >>>> likely llc >>>> likelyllc.com >>>> >>>> Stan Developer >>>> mc-stan.org >>>> >>>> BS Mathematical Sciences: Probabilistic Methods >>>> BS Statistics >>>> University of Michigan, Ann Arbor 2017 >>>> >>>> On Mon, Jun 1, 2026, 7:34 PM Andre Zapico ***@***.***> >>>> wrote: >>>> >>>>> Whatever feelings don't matter in software dev. >>>>> ***@***.*** >>>>> >>>>> Aditi did you take a look at this? Looking for someone to work with >>>>> with more expertise in OS dev. Theory is important but concurrency clearly >>>>> widely used. >>>>> >>>>> This project could clearly capitalize on this more. >>>>> >>>>> >>>>> Cheers all, >>>>> >>>>> Best, >>>>> >>>>> >>>>> Andre Zapico >>>>> linkedin.com/in/andre-zapico >>>>> gitub.com/drezap >>>>> >>>>> >>>>> ME Information and Communication Engineering >>>>> University of Electronic Science and Technology of China >>>>> >>>>> Consultant, Owner >>>>> likely llc >>>>> likelyllc.com >>>>> >>>>> Stan Developer >>>>> mc-stan.org >>>>> >>>>> BS Mathematical Sciences: Probabilistic Methods >>>>> BS Statistics >>>>> University of Michigan, Ann Arbor 2017 >>>>> >>>>> On Mon, Jun 1, 2026, 1:45 PM Steve Bronder ***@***.***> >>>>> wrote: >>>>> >>>>>> *SteveBronder* left a comment (stan-dev/math#3314) >>>>>> <#3314 (comment)> >>>>>> >>>>>> I blocked because I feel like I've tried discussing this with you >>>>>> and it is taking away from time I would like to spend helping other pull >>>>>> requests and issues get resolved. >>>>>> >>>>>> I've said several times that I'm against this level of automatic >>>>>> parallelization because it will be a lot of maintenance but you keep >>>>>> dismissing my requests without addressing them. I'm going to not reply on >>>>>> this anymore as I just don't know how to continue the discussion in a >>>>>> fruitful way. >>>>>> >>>>>> — >>>>>> Reply to this email directly, view it on GitHub >>>>>> <#3314?email_source=notifications&email_token=ACY543COJERYESC7EJXDBMT45W6NPA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTINJZGUYDOMJXHA42M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-4595071789>, >>>>>> or unsubscribe >>>>>> <https://github.com/notifications/unsubscribe-auth/ACY543FNOWFWAU7P6PJLPAT45W6NPAVCNFSM6AAAAACYLKOWDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHM2DKOJVGA3TCNZYHE> >>>>>> . >>>>>> You are receiving this because you were mentioned.Message ID: >>>>>> ***@***.***> >>>>>> >>>>> >>>>> >>>>> >>>> >>>>

drezap and others added 15 commits April 25, 2026 14:56

change return to referenced argument

a333398

intermediate commit playing with pointers

794e2a5

ok, numerical tests 1,..,10 pass _threading_

bee0559

remove dead code

99114d8

begin benchmarks

2db1474

try no threading

0d66c6f

scale to 10mm obs and 2^17 threads

73c3c76

add only 10 test for multithreading

c539a38

add some unthreaded tests, for varying N and numerical value of exp(10)

442e814

scale N tests

e9583fa

unthreaded tests compile

c1f263f

remove print statement

5b15382

Merge commit '105bfcc395c1ab824dcb588324dd57724a1cf527' into HEAD

b331dd8

[Jenkins] auto-formatting by clang-format version 10.0.0-4ubuntu1

b1c8b69

drezap added 4 commits April 29, 2026 21:14

fix unit test names, rusty, sorry

84675ab

Merge branch 'feature/issue-3311-test-thread-tbb-exp' of github.com:d…

aec6db9

…rezap/math into feature/issue-3311-test-thread-tbb-exp

fix return to satisfy compiler

94db162

change exp to std::exp for numerical accuracy

3fcf593

drezap added 3 commits May 1, 2026 10:59

investigate drift in tests

4b08e16

ifdef0endif don't compile mix tests, they're only supporting complex

d143a04

change investigate drift naming conventions

6837a52

perfect forwarding in parallelizing class

7ca2f6d

Uh oh!

Conversation

drezap commented Apr 29, 2026

Summary

Tests

Side Effects

Release notes

Checklist

Uh oh!

drezap commented Apr 29, 2026

Uh oh!

SteveBronder commented Apr 30, 2026

Uh oh!

drezap commented Apr 30, 2026 via email

Uh oh!

drezap commented May 1, 2026

Uh oh!

stan-buildbot commented May 2, 2026

Uh oh!

drezap commented May 2, 2026

Uh oh!

stan-buildbot commented May 2, 2026

Uh oh!

drezap commented May 28, 2026 via email

Uh oh!

drezap commented May 28, 2026 via email

Uh oh!

SteveBronder commented May 28, 2026

Uh oh!

drezap commented May 28, 2026 via email

Uh oh!

SteveBronder commented May 29, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

drezap commented May 29, 2026 via email

Uh oh!

SteveBronder commented May 29, 2026

Uh oh!

drezap commented May 29, 2026 via email

Uh oh!

drezap commented May 29, 2026 via email

Uh oh!

SteveBronder commented May 29, 2026

Uh oh!

SteveBronder commented May 29, 2026

Uh oh!

drezap commented May 29, 2026 via email

Uh oh!

SteveBronder commented May 29, 2026

Uh oh!

drezap commented May 29, 2026 via email

Uh oh!

drezap commented May 29, 2026 via email

Uh oh!

drezap commented May 29, 2026 via email

Uh oh!

SteveBronder commented May 29, 2026

Uh oh!

drezap commented May 29, 2026 via email

Uh oh!

drezap commented May 30, 2026 via email

Uh oh!

drezap commented May 31, 2026 via email

Uh oh!

drezap commented Jun 1, 2026 via email

Uh oh!

drezap commented Jun 1, 2026 via email

Uh oh!

SteveBronder commented Jun 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

drezap commented Jun 1, 2026 via email

Uh oh!

drezap commented Jun 1, 2026 via email

Uh oh!

drezap commented Jun 1, 2026 via email

Uh oh!

drezap commented Jun 2, 2026 via email

Uh oh!

drezap commented Jun 2, 2026 via email

SteveBronder commented May 29, 2026 •

edited

Loading

SteveBronder commented Jun 1, 2026 •

edited

Loading